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@ Apparatus for effecting Instruction with speech and display. 

An apparatus for effecting Instructions with speech and 
Fsual display In which when a destination input window is 
displayed, a message Is output and a speech track number Is 
simultaneously called to output a corresponding speech. When 
Information on an intersection Is displayed, the travel distance Is 
calculated to display the remaining distance to the Intersection. 
At the same time, a speech Is output by selecting a 
predetermined speech number in correspondence with the 
travel direction and the remaining distance. Also, processing for 
guidance at the Intersection Is performed, and whether or not 
any one of remaining distances in speech tracks of a ROM 
corresponds to the present remaining distance Is determined, 
thereby outputtlng a desired speech In correspondence with 
the traveling direction. The Invention thus enables functions of 
effecting Instruction with speech and display and enables the 
apparatus to be operated quickly and easily. 
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D s ription 

APPARATUS FOR EFFECTING INSTRUCTION WITH SPEECH AND DISPLAY 



This invention relates to an apparatus for effecting 
instructions by using speeches and visual display. 

In office automation apparatus or Information 5 
machines, various kinds of guidance Information for 
desired instructions are indicated on a display 
screen when information is input or output while 
being displayed on the screen. 

Also, a type of vehicle navigation system for 10 
guidance to a destination along a predetermined 
route has been proposed in which the position of the 
vehicle is indicated on a map displayed on a monitor 
TV screen together with an image of a selected 
course. The applicant of the present invention has 15 
also proposed, in Japanese Patent Application 
No. 62-002, a navigation system in which photo- 
graphs of intersections where the driver needs to 
turn the vehicle for traveling to his destination, 
names and configurations of the intersections, the 20 
directions of travel to the intersections are displayed 
on the screen. 

Conventional instruction apparatus, however, 
make use of visual display alone and Instructions 
thereby made are not easy to understand. There is 25 
therefore a possibility of the driver failing to perform 
desired operations. 

The above-mentioned navigation system in which 
the vehicle position is indicated on the map on the 
monitor TV screen together with a selected course 30 
entails a problems in that if an image of an 
intersection where the driver needs to turn the 
vehicle is close to images of other intersections, It is 
difficult for the driver to discriminate the image of the 
former. 35 

The type of apparatus displaying information on an 
intersection where turning is needed, e.g., photo- 
graph and name does not enable the driver to 
definitely ascertain where the vehicle is traveling. To 
cope with this problem, speech output may be used. 40 
This method, however, requires a large quantity of 
speech data, resulting in an increase in the memory 
cost if a ROM is employed or in a delay in access in 
the case of a magnetic tape. 

It is an object of the present invention to provide 45 
an instruction apparatus which makes use of a 
CD-ROM (Compact-disk read only memory) to 
enable a function of effecting instructions with visual 
display and speeches so that the apparatus can 
operated quickly In a simple manner. 5Q 

To this end, the present invention provides an 
instruction apparatus for outputting guidance infor- 
mation on a display screen with speech and visual 
display, having an input section, a memory device for 
storing items of guidance information, and a display 55 
section for outputting one of the items of guidance 
information by information input through the input 
section, wherein the memory device has a CD-ROM 
for storing data on speeches provided as guidance 
data, and ne of the speeches is output when one of 60 
the items of guidance information Is output from the 
display section. 

The present invention also provides an apparatus 



for effecting instruction by using speech and visual 
display in an navigation system for outputting 
information for guidance to a destination, the 
apparatus having an input section, a memory device 
for storing items of guidance information, and a 
display section for outputting one of the items of 
guidance information by information input through 
the Input section, wherein the memory device has a 
CD-ROM for storing data on speeches provided as 
guidance data, and one of the speeches is output 
when one of the items of guidance Information is 
output from the display section. 

In the operation of the apparatus for effecting 
instruction by using speech and visual display in 
accordance with the present invention, a message: 
"select a destination" is displayed after a destination 
input window has been displayed. Simultaneously, a 
speech track number 1 is called to output a speech: 
"select a destination". 

When information on an intersection is displayed, 
the travel distance is detected to calculate the 
distance remaining until the intersection is reached, 
and the calculated remaining distance is displayed 
on the display screen. At the same time, a speech 
truck number is selected in correspondence with the 
traveling direction and the reaming distance, and a 
speech, for example,"turn to the left after traveling 
about 100 m" is output. 

In accordance with the present invention, there- 
fore, the adoption of the CD-ROM realizes functions 
of effecting instructions with visual display and 
speech and enables the apparatus to be operated 
quickly and easily. 

When applied to a navigation system, the present 
invention enables the driver to input a position or 
confirm the vehicle position on a course quickly and 
easily as well as to confirm an intersection at which 
the driver needs to turn the vehicle, by simulta- 
neously effecting speech output and display of a 
map, a photograph of an intersection, and so on. 

Still other objects and advantages of the Invention 
will In part be obvious and will in part be apparent 
from the specification. 

The invention accordingly comprises the features 
of construction, combinations of elements, and 
arrangement of parts which will be exemplified fn the 
construction hereinafter set forth, and the scope of 
the Invention will be indicated in the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram of the construction of a 
vehicle navigation system In accordance with 
the present invention; 

Figs. 2 and 3 are tables of the data structures 
in accordance with the present Invention; 

Figs. 4 to 8 are diagrams of examples of 
display relating to the present Invention ; 

Fig. 9 is a flow chart f the operation of the 
vehicle navigation system In accordanc with 
thepr sent invention having functions of ffect- 
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ing instructions with spe ches and visual 
display; and 

Fig. 10 is a flow chart of a processing in 
accordance with another embodiment of the 
present invention. 

Embodiments of the present invention will be 
described below with reference to the accompa- 
nying drawings. 

Fig. 1 shows the construction of a vehicle 
navigation system to which the present invention is 
applied is illustrated. The navigation system has a 
distance recorder 1, a steeling angle sensor 2, an 
input section 3, an input decoding section 4, an input 
decoding table 5, a data processing section 6, a 
drive control section 7, a display section 8, a 
navigation data file 9, a map data file 10, a 
photographic data file 11, a speech data file 12, a 
drive control section, and a speaker 14. 

The distance recorder 1 is adapted to measure the 
distance through which the vehicle has traveled. The 
distance recorder 1 may be a means for detecting 
the number of revolutions of a wheel, a means for 
detecting the acceleration and integrating a de- 
tected value two times, or other measuring means. 
The steering angle sensor 2 which detects whether 
or not the vehicle has turned a corner may be 
constituted by an optical rotary sensor, a rotary 
variable resistor or the like attached to, for example, 
a rotary member of the steering wheel or may be an 
angle sensor attached to the steering system. 

The input section 3 is constituted by a touch panel 
and Is used, in combination with the screen of the 
' display section 8, to show keys and a menu on the 
screen and enable Input through the screen. 

The input decoding section 4 is adapted to 
decode data input through the input section 3 by 
referring to the input decoding table 5. If, for course 
setting, a present point and a destination point are 
input, they are converted Into present point data and 
destination data with on the basis of the input 
decoding table 5. The Input decoding table 5 Is 
therefore set in correspondence with the kind of 
data input through the input section 3. 

The data processing control section 6 is the 
center of the navigation system. When a course is 
set by input through the input section 3, the data 
processing control section 6 reads out navigation 
data relating to the course stored in the file 9 and 
execute processing with this data. The navigation 
data is prepared for operations of Indicating, on the 
display screen of the display section 8, guidance 
maps for the traveled course, displaying photo- 
graphs showing specific features of Intersections as 
well as landmarks on the course, and displaying 
other item of guidance information including the 
distance remaining until each intersection Is reached 
while outputting speech guidance though the 
speaker 14. 

Items of data on such maps, photographs and 
speeches are stored in the files 10 to 12 set in the 
CD-ROM 15. The drive control section 7 controls the 
image output to the display section 8, and the drive 
control section 13 controls the speech output to the 
speaker 14. Th time at which speech signal 
r cording starts, the time at which the recording 



ends, the track number assigned to each speech 
signal are stored in the CD-ROM 15 together with 
items of data on Images In correspondence with 
speech signal recording time and the truck number. 

5 Otherwise, the map data 10 and the photographic 
data 11 may be stored in a ROM 16 of a CPU 17. In 
this case, the ROM 16 stores image data and 
coordinate data. 
When this navigation system selects a course by 

10 being supplied with a present point and a destination 
point through the input section 3 before traveling, 
the data processing control section 6 reads out 
navigation data stored in the file 9 corresponding to 
the selected course and executes processing on the 

15 bases of the navigation data. The navigation data Is 
used to display through the display section 8 
guidance charts, the present position, guidance at 
intersections and so forth for the selected course on 
the basis of measurement information supplied from 

20 the distance recorder 1 and the steering angle 
sensor 2. 

Next, the structure of speech data relating to the 
present invention will be described below with 
reference to Figs. 2 and 3. 

25 Fig. 2 shows speech data stored in the CD-ROM 
15 in which groups of data items representing 
speeches as illustrated are stored with respective 
truck numbers. 
Fig. 3 shows data for calling track numbers 

30 assigned to the data items stored in the ROM 16 or 
the CD-ROM 15. The speech truck numbers are 
placed In correspondence with combinations of 
leftward/rightward traveling directions and values of 
remaining distance. 

35 Next, the flow of processing for instruction 
functions using speeches and visual display which is 
specific feature of the present invention will be 
described below with reference to Fig. 9. In the 
illustrated example, a destination is input. In step 21, 

40 a destination input window such as that shown in 
Fig. 4 is displayed first. In this example, the 
destination is displayed as one of destination items: 
"sight-seeing", "meal", "lodging", "souvenir" and 
•return" while portions of the touch panel though 

45 which Inputting is possible are indicated with red 
illumination, and a message: "select your destina- 
tion" is also displayed. At the same time, in step 22, 
the speech track number 2 (Fig. 2) is called, and the 
speech: "select your destination" is output. 

50 In step 23, whether or not an Input through the 
touch panel Is within the display region of the 
selection items is checked. This is a processing for 
doing the touch input again if a portion out of the 
display region has been touched by the finger. If the 

55 input is within the display region, whether or not 
"return- has been selected through the window 
shown in Fig. 4 is checked in step 24. If, for example, 
"sight-seeing" has been selected, the process 
proceeds to step 29 to display a place name list 

60 selection window such as that shown in Fig. 5. At the 
same time, in step 30, the speech track number 3 
(Fig. 2) is called and the speech: "select your 
destination" Is output. 
Then, In step 31, whether or not the input through 

65 the touch panel is within the display r gion of the 
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items to be selected Is checked. If it Is within the 
display region, whether the selected Item is "pre- 
vious page" or "next page" is checked in step 32. If 
YES, the place name list display page is changed in 
step 33 and the process r turns to step 29. After one 
of the selection items in the displayed window has 
been selected, a selected place name confirmation 
window such as that shown in Rg. 6 is displayed in 
step 34. Through this window, the selected place 
name is displayed together with red-illumination 
display of "OK" and "cancel". Simultaneously, a 
speech: "is it all right" is displayed. At the same time, 
in step 35, the speech track number 4 (Fig. 2) is 
called and the speech "Is it all right" is output. 

Similarly, is step 36, whether or not the Input 
through the touch panel Is within the display region 
of the selection items is checked. If it is within the 
display region, whether or not the selected item is 
"OK" is checked In step 37. If "cancel" has been 
selected, the process returns to step 29 and the 
above-described processing is repeated. If "OK" has 
been selected, the process returns to the main 
navigation process. 

If in step 24 "return* shown in Fig. 4 has been 
selected, a "return" confirmation window such as 
that shown in Fig. 7 Is displayed in step 25, and a 
message: "will you return" is displayed. At the same 
time, in step 26, the speech track number 2 (Fig. 2) is 
called and the speech: "will you return" is output. In 
step 27, whether or not the input through the touch 
panel is within the display region Is checked. If it Is 
within the display region, whether or not the selected 
item is "YES" is determined in step 28. If "NO", the 
process returns to step 21 to repeat the above-de- 
scribed processing. If "YES", the process returns to 
the main navigation process. 

Next, another embodiment of the present inven- 
tion will be described witrLreference to Fig. 10. In the 
second embodiment, the function of effecting 
instructions with speeches and visual display is 
applied to guidance at intersections. First, in step 51, 
intersection information on the traveling direction to 
be selected at an intersection, the distance to the 
intersection, and so on is set and, in step 52, the 
intersection information is displayed as shown in 
Fig. 8. In this case, the name and a photograph of the 
intersection and the traveling direction are dis- 
played. Then, In step 53, the travel distance is 
detected to calculate the distance remaining until 
the intersection is reached and, In step 54, the 
calculated remaining distance is displayed on the 
screen. In step 55, whether or not any speech Is 
being output is checked. If a speech is being output, 
the process returns to step 53. If no speech output, 
whether or not one of remaining distances in speech 
tracks of the ROM corresponds to the present 
remaining distance is determined in step 56. In the 
case of NO, the process returns to step 53. In the 
case of YES, the speech track number Is selected In 
correspondence with the traveling direction and the 
remaining distance in the data shown in Fig. 3, and a 
speech: "turn to the left after traveling about 100 m B 
is output. 

The present invention is not limited to the 
above-described embodiments and can otherwise 



be modified In various ways. 

For example, th invention is not limited to the 
navigation system but applicable to learning/instruc- 
tion machines which mak use of both visual display 
5 and speech. 

In the above described embodiment, the instruc- 
tion functions based on speech and visual outputs 
are applied to destination inputting and intersection 
guidance. The present invention, however, is not 
10 limited to this, and it can be applied to the process of 
inputting the present point, processing of various 
kinds of guidance information, explanation of input- 
ting procedure, and other operations. 

15 

Claims 



20 1. An instruction apparatus for outputtfng 

guidance information on a display screen with 
speech and visual display, comprising an input 
section, a memory device for storing items of 
guidance information, and a display section for 

25 outputting one of said items of guidance 

information by information input through said 
input section, wherein said memory device has 
a CD-ROM for storing data on speeches 
provided as guidance data, and one of said 

30 speeches Is output when one of said items of 

guidance information is output from said display 
section. 

2. An apparatus for effecting instruction by 
using speech and visual display in an navigation 

35 system for outputting information for guidance 

to a destination, said apparatus comprising an 
input section, a memory device for storing 
items of guidance information, and a display 
section for outputting one of said items of 

40 guidance information by information input 

through said input section, wherein said mem- 
ory device has a CD-ROM for storing data on 
speeches provided as guidance data, and one 
of said speeches is output when one of said 

45 items of guidance information is output from 

said display section. 

3. An apparatus for effecting instructions by 
using speech and visual display according to 
claim 2, wherein a destination point or a present 

50 point Is input through said input section. 

4. An apparatus for effecting Instructions by 
using speech and visual display according to 
claim 2, wherein said guidance information 
includes information on intersections. 

55 5. An apparatus for effecting instructions by 

using speech and visual display according to 
claim 2, wherein said guidance information 
includes explanation of inputting procedure. 

60 
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Fig. 2 
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Fig. 3 
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Fig. 5 



(sight- seeing SELECT A PLACE YOU WANT TO GO. 




////// /////// 




// NANZEN-Jl/VV 

//////// / /// 






V,, /// 




/// // /////// 
// HEIAN - JINGU/V 

/ / / , / s s / s / / / 




' MARUYAMA KOUEN/ 




V/™w//a 




/ preVioO^/ 




v/next y y 









Fig. 6 



SIGHT-SEEING | S | T ALL RIGHT ? 








NANZEN-JI 
























///"///// 



EP 0 323 245 A1 



Fig. 7 




Fig. 8 



500m AHEAD 
FOOT OF 
KANDA MYOJIN 


Iff* 


X ) c 







EP 0 323 245 A1 
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Fig .10 
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